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Abstract 

The matrix differential equation x\t) — Q{t)x{t),x{Q) — xq is considered 
in the case where Q{t) is an unspecified matrix function of time, with the 
only constraint that Q{t) € ^ for every f , where =S is a prescribed closed and 
convex set of matrices. We provide the solution of the generalised equation 
by defining an exponential of a set of matrices. Although the defintion is 
not directly applicable to calculate the solutions, we provide an approximate 
method along with the estimation of maximal possible error In particular, 
the method allows estimating continuous time imprecise Markov chains. 

Key words matrix differential equation, interval matrix, exponential of an 
interval matrix, continuous time imprecise Markov chain 
Math. subj. class. 15B15, 15A16 

1 Problem setting 

We consider the matrix differential equation of the form 

^{t) = Qx{t), ^(0)=^o. (1) 

where Q is replaced with a compact convex set of matrices, called an interval ma- 
trix, usually we denote it by and the intial vector xq is replaced by an interval 
vector Interval matrices have been proven to efficiently model the unceitainty 
in parameter estimates, such as in modelling discr e te time Markov chains \y i th un 



known parameters (see for instance lHartfiell l ll998l l. lde Cooman et all 1120091 1. ISkulj 



1 200911 ) ■ One of our main motivations is the modelling of continuous time Markov 
chains with uncertain parameters. We build on the work of Hartfiel [1985], who 
studied the related problem requiring that Q{t) is a piecewise continuous matrix 
function whose values lie between given matrices Q and Q. Moreover, he requires 
zero column sums of all matrices Q(t) and that the elements of xq sum to one. 
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He then shows that the sets of all possible solutions are compact and convex, and 
studies their properties when time t a pproache s infinity. 

In this paper we relax most of the iHartfiell 's assumptions. Thus we allow arbi- 
trary compact convex sets of matrices and in addition we omit any continuity as- 
sumptions. With regard to solutions we provide a directly applicable methods for 
finding approximate solutions, based on linear programming techniques, together 
with error estimates. 

There are two most common interpretations of the equation dill if instead of a 
fixed matrix Q, a set of possible matrices J2 is given. The first one is the sensitivity 
analysis interpretation, where it is assumed that the matrix Q is co nstant in time 
althou g h all that is k nown is that it is contained in J2 (see for instance lOppenheimer 
lll988l] . lGoldszteinl 12009.1 ). 

In this pape r however we a dopt another interpretation, which is similar to the 
one adopted by iHartfiell lll985n . That is, we allow that the matrix Q depends on 
time t in some very general unspecified way. Unlike lltotfiej we do not even make 
any continuity assumptions. The only requirement being that Q{t) is an element of 
J2 at every time t. 

Anoth er related problem is when t h e matrix Q(t) is a known function of time 
t (see e.g. iBohner and Petersoril ll200in . iDaCunhal ll2005n and references therein). 
Our approach would rougly correspond to finding the bounds for all possible such 
solutions when only the bounds are given for Q{t). 

When the general equation ([T]) is considered the closed form solution is ob- 
tained using matrix exponentials: 



xU) 



The approach to the solution of the generalised problem that we propose is based 
on the generalisation of the matrix exponential for the case of interval matrices. 
We show that this is indeed possible and provide methods to find approximations, 
with arbitrary precision that can be estimated in advance. 

The paper has the following structure. In Section |2] we formalize the general- 
isation of matrix differential equations. The solution of the genaralised equations 
is based on the defintion of an exponential of interval matrix defined and analysed 
in Section [3l where a method for practical approximations is presented along with 
the estimation of errors. In Section 51 we prove that the exponentials of interval 
matrices indeed provide the solution of the interval matrix differential equation. 
Finally, in Section |5] we explain how the method can be applied to continuous time 
imprecise Markov chains, and give an example. Some of the technical auxiliary 
results are listed in the appendix. 
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2 Interval matrix differential equations 



2.1 Intervals of vectors and matrices 

All vectors and matrices used here are finite-dimensional and all vectors are as- 
sumed to be column vectors. We will write x<y when Xi < holds for all their 
components. Moreover, we will involve sets of vectors and sets of matrices. All 
operations between sets of matrices or sets of vectors are meant to be elementwise. 
Thus, for instance, given a set of matrices J2 and a set of vectors we denote 

Definition 1. Let x and x be vectors such that x<x. Then the set of vectors 
[x,x] '.= {x: ^ < X < l} is called an interval vector. 

Definition 2. A set of matrices £2 has separately specified rows if for every 2, Q' G 
^ the matrix Q, such that Qij = Qjj for all j and / / /q and Q/gj = Q'l^j for all j, 
also belongs to ^. 

This means that rows of matrices i n J2 can b e chosen independently from some 



sets of row vectors. In the case, such as lHartfieli s. where the set of matrices consists 



of all matrices Q that satisfy the equation Q < Q < Q, this property is already 
implicity assumed by the defintion. 

Proposition 1. Let ^ be a compact convex set of matrices with separately specified 
rows and x a vector. Then there exist matrices Qo,Qi € ^ such that Qqx < Qx and 
Q\x > Qxfor every 2 € cS. 

Proof. Let y. = ming£^(2A;); and let Qj be a matrix that minimizes {Qx)j. Then 
let Q be the matrix whose /th row is equal to the /th row of Qt for every /. Then, 
clearly, (Qx), = (2,x),- which implies that {Qx)i < {Qx)i for every ^ and every 
component /, and this completes the proof. □ 

If =S is a compact convex set of matrices with separately specified rows and x 
a vector then their product is the interval 

^x=[Qx,Qx], (2) 

where Qx := mingg^ Qx and Qx := maxgg^ Qx, which exist by the above propo- 
sition. Moreover, when an interval matrix is multiphed with an interval vector, the 
result is again an interval: 

^\x,x] = [Qx,Qx]. 

Thus every compact convex set of matrices J2 with separately specified rows de- 
fines a (non-linear) transformation of the set of interval vectors to itself. 
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Definition 3. An interval matrix is a compact and convex set of matrices J2 with 
separately specified rows. 



2.2 The formulation of the interval matrix differential equation 

We have shown that an interval matrix ^ maps an interval vector \x,x] to the inter- 
val vector [Qx,Qx]. Consider all vector valued maps x{t) satisfying the following 
inequalities: 

^(0) G [xo,Io] (3) 

xit+h) -xit) — , , 
hmsup ^ ^ < Qx{t) (4) 

x(t + h)-x(t) 
liminf ^ f — > Qx(t), (5) 

h^O h — 

for every t >0. 

Let ^ denote the set of all possible solutions of the above system of differen- 
tial inequalities, i.e. the set of all vector functions x{t) satisfying the inequalities 
©, dH) and ([5]). We are concerned with the sets of vectors ^{t) := {x{t) : x G ^} 
that the possible solutions can take at time t. We will show that every set ^{t) is 
an interval vector of the form [x{t),x{t)]. Moreover, we will provide the method to 
efficiently calculate its bounds. 

The solution of the classical matrix differential equation ([T]) is obtained by 
multiplying the initial vector xq with the exponential of the matrix Q to obtain 
x{t) = e'^XQ. In the next section we define a generalised exponential of an interval 
matrix which will provide the solution of the generalised equation. 



2.3 Computational considerations 

Two crucial considerations when doing computation with interval matrices are 
needed. One is the representation of interval matrices and the other is the com- 
putation of the interval bounds Q. 

Convex sets, and in particular iterval matrices, are represented via sets of con- 
straints that in practical cases are usually finite and allow the computation of the 
bounds of the intervals of the form using linear programming techniques. One 
such example of constraints is the most commonly used interval of matrices 

[Q,Q] = {Q- Q<Q<Q}- 

Problems usually occur when the set of matrices is transformed in a non linear way. 
In our case the transformation is the exponential of an interval matrix defined in 
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the next section. When such transformations are applied, not only it is not easy 
to find the constraints representing the transformed set, but also the cardinality of 
the set of such constraints may exponentially increase or even become infinite. For 
this reason we strive to besides giving the adequate theoretical definitions we also 
develop methods for efficient calculations, which are usually approximate methods. 



3 The exponential of an interval matrix 
3.1 Definition 

Our aim is defining a set of matrices exp(^) that will provide the solution to the 
set of inequalities @ and ^ in the following sense: 

jr(f) = exp{t^)[xQ,xo] = {Px: P e exp{t^),x € [^qj^o]}- 

We have explained in Section [T] that there are different interpretations of interval 
matrix differential equations. When sensitivity analysis interpretation is used, i.e. 
when it is assumed that the differential equation in question is a classical matrix 
differential equation with an unknown matrix Q, that is known to belong to the set 
J2, the adequate way to calculate its exponential is to take the set of all exponentials 
of matrices in J2: 

exp'{^) = {e^: Qe^}. (6) 

This type o f exponential and t he methods for its effi cient calculations have been 
provided by iGoldsztejn ll2009l l. lOppenheimei] l IlQSsh . 



The above exponential, however, is not suitable when our interpretation is 
adopted. Let us explain the main reason, why the exponential ^ does not solve the 
set of inequalities (O, & and Suppose we are trying to find the upper bound 
x{Ati) for the set of solutions at time At\. We may have, for instance: 

x{Ah) = e^"^%. 

where Q\ is the matrix in J2 that maximizes the value e^'^XQ. At time Ati +At2 
let Q2 be the matrix that maximizes e^^^x{Ati). But the resulting upper vector 
x{Ati +At2) is then in general greater than e'^''+^'-'%o for every 2 G cS. 
The exponential serving our purposes is instead defined as follows. 

Definition 4. Let ^ be an interval matrix with separately specified rows. Then we 
define 



?^=ci|n/'a 

where cl denotes the closure of the set. 



e^ = clj]^/'2': ?ieN,£ji = l,e,e^, fori <i<n\, (!) 
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Since interval matrices are compact by definition, this implies that the norms of 
their elements are uniformly bounded by a constant, say M. By Lemma [6] it easily 
follows that the norms of elements in e'^ are uniformly bounded as well with the 
constant . Hence, is a closed set of matrices with uniformly bounded norms, 
which implies that it also compact. Every element of P ^ is therefore the limit 
of a sequence {P,,} of the form 

(=1 

where l^f^Lj df = 1 , > 0, Q'J G ^ for every « € N and 1 < / < yt„. 
Lemma 1. For every a and jS we have that 

Proof. Clearly e'^^e^^ C To see the converse inclusion take an element 

of the form Y['i=i where JJI^y J; = a + j3 and let k be the largest index such 
that di < a. Let dk = d'^ + d'l such that ^fr/ <i,- + <i[ = «■ Then we have that 

i=\ \i=\ J \ i=k+\ J 

which is an element of g^-^^/^-S 

Let P be an arbitrary element of Then there is a sequence {P,,} of the 

form dS) such that P = lim„^oo/'«. Now, by the above considerations, every P„ is a 
product of P'^ € e"'^ and G e^"^ , and since both and e^^ are compact sets, 
both sequences {P,^} and {P"} have subsequences that converge to some P' and P" 
respectively, whence P = P'P" immediately follows and completes the proof. □ 

For simplicity of notation we will denote an element of e^ by e^, although, as 
follows from the definition there might be no Q € such that e^ = e^. 



3.2 Partitions 

Let ^ = {?o , ? 1 , • • • , ?n : ti-\ < f,- , for every 1 < / < « } be a partition of the interval 
[to,tn\. Suppose that 3/"' = {t'Q,t[ is another partition such that t^ = to and 
= tn and C Then we will say that is a refinement of 
For every partition =^ define 



eg- 



Y^t.-t.^OQ, : 2; G ^, for 1 < / < « j. , (9) 
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which is a closed set if ^ is closed. Clearly we have that Cy- C e^, if S/"' is a 
refinement of The definition (|7]) can now be equivalently rewritten as 

e^ = cl|Jef , 
sr 

where =T runs over all possible partitions of the unit interval [0, 1]. 
Further, for every partition =^ = {fo,?i, we denote 

5(5^) = min ti — ti-i, 

l<i<n 

A{^) = max tj — and 

l<i<n 

\sr\ = n. 

We will call a refinement of an elementary refinement if there is at most one 
f[ G =^7' in every interval for !</<«. Further, let be a partition. Then 

we recursively define the following sequence of refinements: 

^(1) = ^ u I : G ^, 1 < / < «| 

and 

Every partition in this sequence is therefore an elementary refinement of the previ- 
ous one. 

Lemma 2. Let 3^ and S^' he partitions such that A{£^') < 5{3^). Then 3li3^' 
is an elementary refinement of S^' . 

Proof. Let t]^ G \t\_ ^ , ? ■ ] where t\_ ^ and t[ are two consecutive elements of S^' . Then 
A(=;7') < < fyt+i — tk and therefore fyt+i cannot lie in the same interval. □ 

3.3 Approximations 

The calculations involving the interval matrix exponentials cannot be performed 
directly, as is the case with the exponential in the case of a single matrices, but 
rather using approximations defined in the previous subsection. In this subsection 
we will derive an approximation method based on linear programming techniques 
along with error estimation. The accuracy of the approximations of the form 
which also are sets of matrices, will be measured using the Hausdorff metric in- 
duced by the operator norm for matrices. Let x be an element in a normed space 
and ^ a compact set. Then the Hausdorff distance between them is 

dnixj'S'') =min||x — jll 
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and the distance between two compact sets is 



da {3C, '3/)=msyi{ max (x, ^) ,max^;ff (y, JT) \ . 

It follows from the above definition that if C ^ then 

dH{3^, ^) = maxdn (y, 3C) ■ 

For every set =^ let = sup^g^ ||x||. 

Definition 5. Given a partition S/" with \3'\ = 'N and A(,^) = D, and an interval 
matrix =2 with = M, let 

A(^, ^) = Ar(£)Mf ^(1+^)^(1.5 + 3e^^). 

Proposition 2. 

A(^,^W)< 2-^(^,5^). 

Proo/ We have that =2"A^,A(^W) =2-"Dande(i+2^)^(1.5 + 3e2^^) < 

g(i+D)M^2 ^ + 3e™), whence the above inequaUty easily follows. □ 

Lemma 3. Let ST' he an elementary refinement of Then 

dH{ef,ef,^<A{^,^). (10) 

Proof We will assume that every interval contains one t^. G since oth- 

erwise, we can form a refinement of J?^' with the centers added of those intervals 
[f/ 1 , ti] that do not contain elements from The result would be a finer partition 

and such that dn < dn {e^.,e^^ . 

Now denote, for every 1 < / < n,di = ti — ?,-i,<i- = ti — 1[ and d'- = tj^ — ti-\, 
where t[ is the unique element of ^' contained in the interval [?,■_!,?;]. Further, let 
D = A(=^), and then we have that d[ and d'l < D for every !<?<«. 

Because of e^ C e^, we have that 



dH{e^,e^}j= max min 



eQ' -eQ 



Every element of e^, is of the form 

g~e' = fje<'e^/"e". (ii) 



;=1 
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d' d" 

Convexity of the set J2 implies that the convex combinations Qi = ■f.Q'i + -^Q'l of 
the elements of for every \ <i <n, belong to ^ as well. To every element of 
the form (fTTT) corresponds the element 



Using Lemma |9l we obtain that 



n 



(=1 



<n{DMf e'-^+^^^ {1.5 + 3e' 



DM\ 



(=1 (=1 

which implies ([TOl l and thus completes the proof. 

Corollary 1. Let a partition ^ and an interval matrix ^ he given. Then 

J//(4,4,„,)<2A(^,^) 

for every n> 0. 

Proof. By Proposition |2] and Lemma[3l we obtain 



□ 



k=o 



k=o " ^ 



<2A(^,^), 



k=0 



where := ^. 



□ 



Theorem 1. Let a partition ^ and an interval matrix £2 he given. Then we have 
that 

dH{ef,e^)<2A{£,^). (12) 



Proof Denote A^= \^\,M = \\^\\ mdD = A{£^). Let £> be arbitrary and 5i a 
partition such that dn (efj , e-^) < e. Further let n be large enough that A ) < 

£ and that A(^("') = f < Then let = y ^j. We have that 

A(#) < % and, by LemmaEl # is an elementary refinement of ^^^"■^ and also a 
refinement of Therefore, < dnie^^^e^) < £ and cf// (e^ , e^(„, ) < 

A(=S, < £, by Lemma|3l which implies that dnie"^ ,e-^^„^) < le and then, by 
Corollary n dH{e^,ef) < 2{A{^ , ST) + e) , and since £ can be made arbitrarily 

□ 



small, this implies (1121) . 
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Corollary!. Let ^ be a partition with A{£^) = D, 6 = d and \\^\\ =M. Then 



Proof. The inequality is a direct consequence of Theorem [T]and the fact that \ ^\< 
i □ 



Corollary 3. Let ^ be a partition with A(^) = = D and 

dH (4 ,e^)< 2DM2^'( 1+^)^ ( 1 .5 + 3^^™) . 



M. Then 



For actual calculations, however, calculating exponential at every time slice is 
not very practical. We now show that the matrix exponential can be approximated 
with linear factors. 

Theorem 2, Let ^ be a partition of the unit interval and ^ an interval matrix. 
Further let A(5') = D, =N and = M. Denote di = ti - for every 
I <i <N. Then for every e^ S there exist matrices Qi,..., Qn so that 



N 

eQ-Yl{I + diQi 



<N{DMf {2e^^+^^" {1.5 + 3e^^)+0.5e^). (13) 



Proof. By Theorem [T] there exists e^' = Ylh=i^'^'^' ^ ^^^^ ^ (^e^' ,e^^ < 
2A(=2, By Corollary |9] we have that 



Yle'-Q^-flil + dtQi 

i=\ 



N 

a 

!=1 



Combining the above inequalities gives (1131 ). 



□ 



Corollary 4. Let =S be an interval matrix with \\^\\ =M. Then for every e^ G e"^ 
and every N there exist matrices Qi,. ■ ■ , Qn so that 



W+nQ 



<2^e(i+^)^(1.5 + 3e^+0.5e'^). 



4 Solutions of the interval matrix differential equation 

In this section we prove that the exponential of an interval matrix ^ indeed pro- 
vides the solution to the inequalities Q, dUl and (|5]l, and that the solutions are 
interval vectors. 
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Theorem 3. Let 2. he an interval matrix. Then, for every x, the set e x is an 
interval, which we denote by \e^x,e^x]. 

Proof. We will use the same notation as in the proof of Theorem |2] 

Let j7 be a partition of the unit interval such that the right hand side in ([T3] ) 
is smaller than e, where £ > is arbitrary. Because the rows of ^ aie sepa- 
rately specified, so are the rows of / + diJS for every I < i < N and therefore, 
by Proposition [T] and the discussion following it, the set {H^Li^I + diQi)x: Qi G 
^ for every \ <i <N} i?, an interval [i,^^,^^]. Moreover, for every e^ G e^ we 
have thatx^r > e^x — e\\x\\ and similarly xa^ < e^x + e\\x\\. 

Although xar and x y may not belong to e^x, there are, by Theorem |2] some 
y ^ and y y € e^x such that ^xa^ —Ja^W and \\x,^ —y,3r\\ < £■ This together with 
closedness of e-^x clearly implies that x = mi^-xy- and x = sup^x,^ belong to e^x 
which is then equal to the interval [x,x]. □ 

Corollary 5. Let ^ be an interval matrix. Then, for every interval vector [x,x], the 
set e'®[x,x] is an interval, which we denote by \e^ x,e^x\. 

Every e^xo, where e'^ G e^ and xo G [xo,xo], satisfies the inequalities (|3]l, (01) 
and (ID by construction. The following theorem shows that the converse also holds. 

Theorem 4. Let x(t) satisfy (O, (|4]l and (H), where is an interval matrix. Then 



Proof. Because of symmetry we only prove that x(l) < e^x^. Suppose that ||^|| < 
M and let £ > be given. Compactness of the interval [0, 1] implies the existence 
of n large enough that 



for every sequence of matrices 2i , . . . , 2„ G =S, which is possible by Corollary |9] 
Now let be the matrices such that 



x(l) G [e£xo, Ao]. 




for every f G [0, 1 — l/«]. Further, let n be large enough so that 




(14) 
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and 

By (HI, 
Now let 



dH{x{\),e^xo)<£. (15) 
dk = max I Xi 



- -* - 

nj \n 

where x, denotes the /th component of the corresponding vector. 



We have 



k\ fk\ fk-\\ 1 fk-l\ 1 

- -X - <x }+-Qkx[ +-£ 

«y \n J \ n J n \ n J n 

k-l\ 1 fk-\ 

- -QkX 

n J n 

<dk-i + -\\Qk\\dk-i + -e 
n n 

( M\ 1 

< 4-1 1 + — + 
\ n J n 

In the above equations all constants are used as constant vectors. The values of 
(ijt are therefore bounded from above by the solutions of the recurrence equations 

dk = dk-\ (l + ^) + whose solution is (i^ = (( 1 + ~ 1 ) ^i^d therefore 



"^n < ~ 1)- C2]>> the distance between x(l) and some element in e^xo is 

smaller than dn + £, which can be made arbitrarily small by taking e small enough. 
Therefore we conclude that x(l) —e^x^ < which is equivalent to saying that 
x(l) < e^XQ. This concludes the proof. □ 



5 The relation with continuous time imprecise Markov 
chains 

The method described in previous sections has a direct applicability in the theory 
of continuous time Markov chains. Consider Kolmogorov's backward equation 

jP{t) = QP{t) 

and let xq be an arbitrary column vector. Then we denote x{t) = P(f)x(0), where 
x(0) = Xq. The Kolmogorov's equation then translates into 

^x{t)=Qx{t), 
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which is exactly the same equation as ([T]). When imprecision is involved it can be 
represented through a convex set of generator matrices which then allows the 
generalisation of the above equation as in (I3]l-(l5]l. The solutions of the generalised 
Kolmogorov equations are then of the form of function X {t\ where all SC(t) 
are interval vectors. Hence we can write 3C (t) = ^{t)^x{t)\. This induces the 
operators 

T{t)-.x^x{t) 

and 

T(f): x^xif), 

which are known from the theory of discrete time imprecise Markov chains as the 
lower and upper transition operator, now dependent on time. Therefore we have 
a natural correspondence between the solutions of the generalised Kolmogorov's 
equation and transition operators, similarly as in the precise case of continuous 
time Markov chains. 

Let us conclude with an example. 

Example 1. Let an imprecise generator matrix be given in terms of a matrix inter- 
val ,^ = [2,2], where 

1-1 4 \ /-5 5 2 \ 

G= 2 -4 1 and 2=3-32, 

V 3 -6/ V 1 4 -4/ 

and all 2 S =S are assumed to have zero row sums. 

Let us approximate e^ '^^ with (/ + — cS)". When n = 80, the maximal theo- 
retical error is 0.12 and the approximate lower and upper bounds are 

/0.3164 0.3839 0.0421 \ /0.4945 0.4984 0.2338\ 

P(0.2) = 0.1545 0.5826 0.0927 P(0.2) = 0.2864 0.6921 0.2338 
\0.0635 0.3340 0.4019/ \0.1853 0.4432 0.5323/ 

With n = 200, the maximal theoretical error drops to 0.02 and the lower and upper 
bound are approximated with 

/0.3181 0.3830 0.0420\ /0.4957 0.4972 0.2333\ 

P(0.2) = 0.1541 0.5836 0.0924 P(0.2) = 0.2858 0.6928 0.2333 
\0.0633 0.3332 0.4033/ \0.1849 0.4421 0.5334/ 

The presented method is apparently not very efficient in terms of convergence. 
Therefore, it remains a challenge for further work to find more efficient methods 
for estimating imprecise continuous time Markov chains. 
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A Inequalities 

Here we list some of the technical results that are used in the proofs of the main 
results in the paper. 

Let /i , . . . ,/„ and /(,... ,//, be continuous mappings in a normed space X. For 
every I <i <n denote 

Fi=f\°---°f°fi+\_°---°fn- (16) 



14 



Lemma 4. Suppose that ||yj'|| < M and ||/,- — f'i\\ < d for every I < i < n. 
Then 



l^n-^oll <ndM 



Proof. We first notice that 



1^,- = ll/l o • • • °f°fi+\ °---°f!,-fl°-- -ofi-l °fi°-- -ofnl 

<\\fl°---°fi-l\\\\f!-fl\\\\f!+l°---ofn\\ 

<M''-^d. 



(17) 



Further we have 

\\Fn —Fo\ 



i=l 



<£ll^/-^i-i|| <nM"-^d. 



1=1 



(18) 
□ 



The following corollary follows immediately from the above proof. 
Corollary 6. Let, under the assumptions ofLemma^ the inequality 

\\fi°---°fi-i\\\\f'i+iO-.-of;^\\<A 

hold for every I <i <n. Then 

\\Fn — -foil < ndA. 

In the sequel, we use for matrices an operator norm induced by any of the 
equaivalent vector norms for finite dimensional vector spaces. 

Corollary 7. LetA[ andA2 be square matrices and let ||A,|| < Mfor i = 1,2. Then 

||A'^-A^|| <nM"-^\\Ai-A2\\ 

for every « G N. 

Lemma 5. For every x>Owe have the inequality 

1 



Proof. We have 



.^.n\ .^Jn+\ 



x" 1 



2 „x 



n=2 ' 



„t'o(« + l)(« + 2)n! - 2 



□ 
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Lemma 6. Let Q be an arbitrary matrix. Then 
Proof. 



\eQ\\<e\\ 



Qn 



n=0 



n=0 



□ 



Lemma 7. For every matrix Q we have that 



\eQ-I-Q\\<l\\Qfe\\Q\\. 



Proof. We have that 

\\e^-I-Q\\-- 



E — 



n=2 



n=0 



Q- Q" 



(n + l)(n + 2) n! 



<^llGl|Veil 



□ 



,G,.,G2_/_2i-e2|| <M2e^(1.5 + e^). 



Lemma 8. Let Qi and Q2 be arbitrary matrices such that \\Qi jj, \\Q2\\ < M. Then 
Proof. Using the previous lemmas, we obtain 

J2 



ere" 



m+n>\ 



m\n\ 



<E I +E 

n=0 



eie'j 



+ 1 

m=2 



e" 



LeQ2 



ml 



2 



Q1 



(n + 2) 

00 

+ Iieiiiiie2iil 



n=0 



e^ 



< 



+ lieiiive^iii: 

m=0 



(n+l)! 

er 



(m + 2)! 



^11^^11 + Iieiiiiie2ik 



11Q211 



+ ||ej2^liail^llG,ll 

<M2e^(1.5 + e'^). 



□ 
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Corollary 8. Let Q\ and Q2 be arbitrary matrices such that ||, ||22|| ^ 
Then 

11^2,^22 _ ^(21+22 II <M^e"il.5 + 3e"). (19) 
Proof. It follows from Lemma |7] that 

1^21+22 _/_ 2j _ < + e2||Ve>+ail < 2MV^ 

which together with Lemma [8] implies ([T9l ). □ 
Corollary 9. Let Qi, ■ ■ ■ ,Qn be matrices with \\Qi\\ < M for every \ <i <n. Then 

ll^e, . . .^a _ (; + . . . (/ + 2„)|| < ^M^exp . (20) 

Proof. We follow a similar procedure as in the proof of Lemma 5] Let /, = e^' and 
fl = {I — Qi) for every I <i <n, and define Fj as in ( fT6l ). By Lemmas [6] and |7J Eq. 
(fTTl ) and noting that ||/ + Q\\ < ell^H we obtain 

\\Fi-Fi^i\\ < WeQ'eQ' ■ ■■e'^'-^ \\ \\e'^'-l-Qi\\ ||(/ + ft+i) • • • (/ + G„)li 
< Vexp|^£llall)' 

which by ([H]) imphes dJOll. □ 
Lemma 9. Let Q\ and Q'!, for I < i < n, be matrices such that <M 

n 

for a constant M; and let t- and t'-' be positive real numbers such that ^ t\ + 1'- = 1 

1=1 

and tj,tj' < qfor every I <i<n and some constant q. 

t' t" 

Further, let tj = t- + 1'/ and Qi = -Q'j + —Q'/ for every \ <i<n. 

ti tj 

Then 



i=l i=l 



<«(^M)V^+i)^(l.5 + 3e'^'^). 



Proof. We again follow the procedure used in the proof of Lemma 5] Denote 
f = e''^'e'' 2' and f! = e''^' for every 1 <i<n. Using Lemma [6] we obtain 

ii/i . . . A-i II < n Ik'' II ik''"^' II < n = 1^1 + 



i=\ i=l I (=1 
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and similarly, 



||/;+i.../;i|<exp M tt\. 

I i=k+\ J 



Therefore, clearly, 

||/i.../,_i||||//+i.../;i|<.«. 
By Corollary [8] and because of Hf-'Gfll ^ '7^' we have 

liy;--/;'||<(^M)V^(i.5 + 3e'^^). 

Finally, by Corollary |6] we obtain 

11^; -^bll < «(^M)2e('?+i)^(1.5 + 3^'^^), 
where notation ([T6] l is used. 
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